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Frames  Generated  By  Subspace  Addition  * 

Y.  C.  Pati  t 


Abstract 

Given  two  subspaces  M  and  TV  of  a  Hilbert  space,  and  frames  associated  with  each 
of  the  subspaces,  the  question  addressed  in  this  report  is  that  of  determining  when  the 
union  of  the  two  frames  is  a  frame  for  the  direct  sum  space  M  ®  N.  We  provide  sufficient 
conditions  for  the  union  of  the  two  frames  to  be  a  frame  for  M  ©  N  and  also  estimates  for 
the  frame  bounds.  The  results  discussed  here  are  given  in  terms  of  the  relative  geometry 
of  subspaces.  Some  simple  examples  in  which  the  frame  bounds  can  be  expicitly  computed 
are  provided  to  demonstrate  accuracy  of  the  frame  bound  estimates. 

1  Introduction 

Any  vector  in  a  seperable  Hilbert  space  can  be  expanded  via  an  orthonormal  basis,  i.e.  written 
as  a  linear  combination  of  the  basis  elements.  Thus  orthonormal  bases  provide  orthogonal 
decompositions  of  Hilbert  spaces.  As  a  natural  generalization  of  orthonormal  bases,  Duffin 
and  Schaeffer  [3]  introduced  the  concept  of  frames  for  Hilbert  spaces.  Frames  define  non- 
orthogonal  decompositions  of  a  Hilbert  space.  Any  vector  in  a  Hilbert  space  can  be  written  as 
a  linear  combination  of  the  frame  elements  where  the  expansion  coefficients  can  be  computed 
via  the  frame  operator  (see  Section  2).  In  most  applications  of  frame  decompositions  (e.g. 
wavelet  transforms)  the  approach  has  been  to  start  with  a  frame  for  the  space  of  interest  and 
then  use  the  frame  to  decompose  vectors  in  the  space.  Here  we  consider  the  situation  where 
we  start  with  frames  for  subspaces  of  a  larger  Hilbert  space  and  construct  a  frame  for  the  sum 
of  two  subspaces  by  taking  unions  of  the  subspace  frames.  Succesive  approximation  schemes 
(c.f.  [6])  in  which  approximations  to  functions  are  successively  refined  provide  examples  of 
applications  in  which  this  approach  is  useful. 

We  show  in  Section  3  that  given  subspaces  M  and  A  of  a  Hilbert  space,  and  frames 
associated  with  each  of  the  subspaces,  the  union  of  the  two  frames  is  a  frame  for  M  ©  N 
whenever  the  minimum  angle,  0m  between  the  two  subspaces  is  bounded  away  from  zero.  We 
also  show  that  the  lower  frame  bound  for  the  union  of  the  two  frames  can  be  bounded  below 
in  terms  of  the  quantity  (1  —  cos  0m ),  and  bounded  above  by  the  minimum  of  the  lower  frame 
bounds  associated  with  the  frames  for  M  and  N  individually. 

‘This  research  was  supported  in  part  by  the  National  Science  Foundation’s  Engineering  Research  Centers 
Program:  NSFD  CDR  8803012,  the  Air  Force  Office  of  Scientific  Research  under  contract  AFOSR-88-0204  and 
by  the  Naval  Research  Laboratory. 

Electrical  Engineering  Department  and  Systems  Research  Center,  University  of  Maryland,  College  Park, 
MD  20742  and  Nanoelectronics  Processing  Facility,  Code  6804,  Naval  Research  Laboratories,  Washington  D.C. 
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2  Hilbert  Space  Frames 

Definition  2.1  Given  a  Hilbert  space  TL  and  a  sequence  of  vectors  {hn}n€%  C  ft,  { hn }  is 
called  a  frame  if  there  exists  constants  A  >  0  and  B  <  oo  such  that 

m\2<  Ei  </.*»>  i2  <-bii/ii2.  (i) 

n 

for  every  f  £  ft.  A  and  B  are  respectively  the  lower  and  upper  frame  bounds. 

Remarks: 

•  A  frame  with  frame  bounds  A  =  B  is  called  a  tight  frame. 

•  Every  orthonormal  basis  is  a  tight  frame  with  A  =  B  =  1. 

•  A  tight  frame  of  normalized  vectors  for  which  A  =  B  =  1  is  an  orthonormal  basis. 

Given  a  frame  {hn}  in  the  Hilbert  space  ft,  with  frame  bounds  A  and  B,  the  frame  operator 
S  :  ft  — y  ft  can  be  defined  as  follows.  For  any  f  £  ft, 

Sf  =  ^<f,hn>hn.  (2) 

n 

We  list  in  the  form  of  a  theorem  some  properties  of  the  frame  operator  which  we  shall  find 
useful.  Proof  of  these  and  other  related  properties  of  frames  can  be  found  in  [5]  and/or  [2]. 

Theorem  2.1 

(i)  S  is  a  bounded  linear  operator  with  AI  <  S  <  BI ,  where  I  is  the  identity  operator  in  ft. 
(ii)  S  is  an  invertible  operator  with  B~lI  <  S-1  <  A-1/. 

(in)  The  sequence  {5,_1h?l}  is  also  a  frame,  called  the  dual  frame,  with  frame  bounds  B_1 
and  A~l . 

(iv)  Given  any  f  £  ft,  f  can  be  written  in  terms  of  the  frame  elements  as 

f  ~^2<  /> S hn  >  K  =  <  fihn  >  S~1hn.  (3) 

(v)  Given  f  £  ft,  if  there  exists  another  sequence  of  coefficients  {an}  (other  than  the  sequence 
{<  f,S~^hn  >}/  such  that  f  =  J2anhn,  then  the  an’s  are  related  to  the  coefficients  given 
in  (3)  by  the  formula, 

£  Kl2  =  E  I  <  /,  S-'hn  >  I2  +  E  I  <  /,  S~xhn  >  —an\2.  (4) 
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3  Frames  Generated  by  Subspace  Addition 


Definition  3.1  Given  two  subspaces  M  and  N  of  a  Hilbert  space  H,  the  smallest  angle  6m 
between  M  and  N  is  defined  as, 

cos 0m  =  sup  sup  |<®,2/>|, 

x£M  y€N 

ININ1  ININ1 

where  6m  £  [0, 7r/2] . 

We  shall  make  use  of  the  following  Theorem  in  proving  the  main  result  (Theorem  3.2)  of  this 
section. 


Theorem  3.1  Let  M  and  N  be  subspaces  of  a  Hilbert  space  Tiwith  M  HN  =  {0}.  And  let  Pm 
and  PN  be  orthogonal  projectors  on  M  and  N  respectively.  Then 


inf 

xeMQN,  ININo 


II  (pM  ~  Piv)z|| 

11*11 


=  sin  0m. 


Proof:  See  [7] 


Theorem  3.2  Let  M  and  N  be  nontrivial,  closed  subspaces  of  a  Hilbert  space  TL.  Let  { Xj }  be 
a  frame  for  M  with  frame  bounds  Am  and  Bm,  and  { y3  }  be  a  frame  for  N  with  frame  bounds 
An  and  Bn-  Define  Q  =  Span({a:j}  (J  {yj}). 

Let  6m  denote  the  minimum  angle  between  the  subspaces  M  and  N . 

Then  if,  0m  >  0  {xj,  yj}  is  a  frame  for  Q  with  frame  bounds 

Aq  >  Aq  =  min  (Am,  An )  (1  -  cos  6m) 

Pq  <  Bq  =  max(PM,  BN)  min(2,  - - —)  (5) 

-L  COS  v pYi 

Proof: 

Note  that  M  D  N  —  0  by  the  hypothesis  that  0m  >  0.  So  Q  =  M  ®  N  and  thus  if  g  £  Q 
there  is  a  unique  decomposition  of  g  as  g  =  x  +  y  where  x  £  M  and  y  £  N. 

Lower  Frame  Bound: 

Take  g  £  Q  and  let  Pm  and  Pjy  he  orthogonal  projection  operators  onto  M  and  N  respec¬ 
tively. 

'£\<S’*i>\2  +  \<9,Vi>\i  =  I  <  xi  >  I2  +  I  <  PN9,  Vj  >  I2 

3  j 

>  AM\\pMg\\2  +  ^TvIlPivi'll2 

>  mm(AM,AN){\\PMg\\2 +  \\Pn9\\2}  (6) 

Now, 

\\pMg\\2  +  UPat^II2  =  \\PMg  -  pN9\\2  +  2Re  (PMg,  PNg) 

>  [inf  2  llffll2  ~  2 1 (pMg,  pNg)\ 

=  An29m\\g\\2 -2\(PMg,pNg)\ 

>  sin2  9m\\g\\2  ~  2||PM5||||-PiVff||  cos6»m 

>  sin2  #m||<7||2  —  (\\PMg\\2  +  ||P/v5||2)  cos6»m 

(7) 
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Therefore, 


(8) 


(\\Pm9\\2  +  ||-PjvS||2)  (1  +  cos0m)  >  sin2  0m\\g\\2 

Or  equivalently, 

WPmsW1  +  II^mII2  >  llflll2  =  1  =  (l  -  cos  K)  Ml2  (9) 

Thus  from  (6)  and  (9)  we  get 

T,\<9,*i>\i  +  \<  9i  Vj  >  P  >  min(AM,Ajv)(l  -  cos0m)  ||.9||2 

3 

Upper  Frame  Bound: 


EK^PP  +  KMpf  <  Bm\\Pm9\\2  +  BN\\PNg\\2 

3 

<  BM\\g\\2  +  BN\\g\\2  <  2ma,x(BM,BN)\\g\\2  (10) 

Also, 

II^Mfiil2  +  ||^W5||2  =  \\Pm9  ~  Pn9\\2  +  2Re  (Pm9,  Pn9) 

<  Wgf  +  2Re  (PM  9,  Pn9) 

<  IMP  +  2\\PMg\\\\PNg\\cos6m 

<  IMP  +  (II-Pm^II2  +  \\Pn9\\2)  cos  em 

(ii) 


Thus, 

(\\Pm9\ 

So  we  also  have, 

(12) 

J2  \  <9’xj>  l2  +  l 

i 

<  9 ,  Vj  >  P  <  max( BM,  BN )  j  _  cqs  ^  IMP 

(13) 

Therefore  (by  (10)  and  (13)), 

Bq  <  Bq  =  max(JBM,5Ar)min(2,- - — ) 

1  —  COS  Um 


It  should  be  noted  that  the  conditions  under  which  Theorem  3.2  guarantees  the  union  of  two 
frames  to  be  a  frame  for  their  combined  span,  are  only  sufficient  conditions.  In  fact  in  all  finite- 
dimensional  cases,  these  conditions  are  not  necessary.  In  these  cases,  estimates  of  the  frame 
bounds  can  be  made  using  knowledge  of  the  correlations  ((xi,Xj))  among  the  frame  elements 
themselves.  However  as  we  show  by  example  in  the  next  section,  in  an  infinite-dimensional 
setting,  the  union  of  two  frames  can  fail  to  form  a  frame  if  6m  =  0. 

As  can  be  seen  from  Equation  (5),  the  estimate  Aq  of  Theorem  3.2  for  the  lower  frame 
bound  Aq  is  always  less  than  or  equal  to  min  (Am,  An).  We  now  show  that  the  actual  lower 
frame  bound  Aq  must  indeed  be  less  than  or  equal  to  min(Ajvf ,  A/v).  To  show  this  we  first 
prove  the  following  lemma. 
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Lemma  3.1  Let  M  and  N  be  nontrivial,  closed  subspaces  of  a  Hilbert  space  H.  M  fl  N  =  {0}. 
Define  Q  =  M  ©  N .  Then  'ix*  £  M,  3  g*  £  Q  such  that 

PMg*  -  x*  and  PNg*  =  0.  (14) 


In  particular, 

g*  =  (/  -  Pn){I-  Pm Pv)~V, 

satisfies  (14). 

Proof:  First  note  that  'ix  £  Q,  (I  -  Pjg)x  £  N 1  fl  Q  Secondly  since  \\PmPn\\  <  1, 
(/  —  PmPn)~ 1  exists  and  is  given  by 

OO 

(/-  PmPn)~'x  =  ^2(PMPN)kx.  (15) 

k= 0 

For  any  x  £  M,  (I  —  PmPn)~1x  £  M  since  every  term  of  the  series  in  the  right  hand  side  of 
Equation  (15)  is  in  M  and  M  is  closed.  Now  let  x  =  (I  —  PmPn)~1x *  and  let  g*  =  (7  —  Pn)x. 
Clearly  Pjyg*  =  0.  Also, 

PMg*  =  Pm(I-Pn){I-PmPn)~xx* 

=  Pm(I  ~  PmPnY'x*  -  PmPn(I  ~  PmPnY'x * 

=  (I-PmPnY'x*  -PMPN{I-PMPN)-lx*  (since  {I  -  PMPN)~lx*  £  M) 

=  (I- PmPn)(I~  PmPnY'x*  =  x*  (16) 


Theorem  3.3  Let  M  and  N  be  subspaces  of  a  Hilbert  space  H.  Let  {xj}  be  a  frame  for  M 
with  frame  bounds  Am  and  Bm  ,  and  {yj}  be  a  frame  for  N  with  frame  bounds  Ajg  and  Big. 
Let  6m  >  0  denote  the  minimum  angle  between  the  subspaces  M  and  N  and  define  Q  —  M@N . 
Then  if  Aq  is  the  lower  frame  bound  for  the  frame  {xj}  U  {Vj}  °f  Q> 

A q  <  rmn{AM,AN). 


Proof: 

Without  loss  of  generality,  assume  Am  <  Ajg.  Thus  since  Am  is  the  lower  frame  bound  for 
the  frame  {xj}  of  M,  for  any  e  >  0,  3  x*  £  M  such  that 

£l<*Vi>l2<(A„  +  e)M2. 

By  Lemma  3.1  3  g*  £  Q  such  that  PMg*  =  x*  and  P/v#*  =  0.  Therefore, 

£|(9>)>I2  +  £|(S',»}|2 

=  £l<PM»Vi}l2  +  £l(Cv9%w>l2 
=  £!(»■•,  *i)l2  +  o 
<  (Am  +  e)||3;*||2  —  (Am  +  €)||5*||2 

Thus  Aq  <  Am  +  t  and  since  e  >  0  is  arbritary  we  have  that  Aq  <  Am  —  min(AM,  An).  ■ 
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4  Examples 

In  this  section  we  consider  a  few  finite-dimensional  examples  in  which  the  frame  bounds  can 
be  explicitly  computed.  The  general  methodology  in  these  examples  is  as  follows. 

Let  T  :  H  — *  l2  be  defined  such  that  T  :  f  — ►  {<  f,xj  >}  where  {a;^}  is  a  frame  for  7 i. 
Therefore  the  frame  operator  S  =  T*T.  If  we  let  {ej}  be  an  orthonormal  basis  for  7 i  then  the 
matrix  representation  of  T  with  repect  to  this  basis  is  given  by 

W  =  [tity]  =  [(*,-,  Cj>]. 

Hence  the  upper  and  lower  frame  bounds  are  given  by  the  upper  and  lower  spectral  limits  of 
W*W.  In  the  finite  dimensional  case,  the  frame  bounds  can  be  computed  as  the  maximum 
and  minimum  eigenvalues  of  W*W  or  equivalently,  the  squares  of  the  maximum  and  minimum 
singular  values  of  T. 


Example  I:  A  frame  for  1R2  from  frames  for  1-D  subspaces 

Let,  x  =  (l,0)r  and  y  =  (sin  9,  cos  9)T .  Define  M  =  Spanja;},  N  =  Span{y};  so  a;  is  a 

frame  for  M  with  frame  bounds  Am  =  Bm  —  1  and  y  is  a  frame  for  N  with  frame  bounds 

An  =  Bn  =  1.  In  this  case  6m  =  6.  Clearly  for  any  angle  6  >  0,  Spanja;,  y}= IR2  =  Q.  Using 

the  standard  orthonormal  basis  for  IR2,  we  get 


W  - 


1  0 

sin  9  cos  9 


Hence 

Aq  =  XntniWW)  =  1-COS  9 
Bq  =  Amax(lT*IU)  =  1  +  COS0 

Since  here  the  lower  frame  bound  is  equal  to  the  lower  frame  bound  estimate  of  Theorem  3.2, 
in  this  case  Theorem  3.2  provides  both  necessary  and  sufficient  conditions.  Figure  1  shows  the 
actual  upper  and  lower  frame  bounds  for  this  example. 


Upper  and  Lower  Frame  Bounds  For  2-D  Example 


0  10  20  30  40  50  60  70  80  90 

subspace  angle  (degrees) 


Figure  1:  Actual  upper  and  lower  frame  bounds  for  two-dimensional  example 
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Example  II:  A  Frame  for  IR3  from  frames  for  1R2  and  1R 

Let  x\  =  (1,0, 0)r,  X2  =  (0, 1, 0)T  and  y  =  (cos u>  cos  0,  sin  u>  cos  9,  sin  0)T .  Let  M  =  Span{:ci,  X2} 

and  N  =  Span{?/}.  Here  6m  =  6.  So  for  any  6  >  0  M  0  N  =  1R3.  For  this  example, 

1  0  0  ' 

W  —  0  1  0 

cos  u  cos  9  sin  u  cos  9  sin  9 

In  this  example  as  well,  we  have, 

Aq  =  XntnQ V*W)  =  1-cos  9 
Bq  =  Amax(VF*LF)  =  1  +  COS0 

Example  III:  Other  Frames  for  1R3  from  frames  for  1R2  nd  1R. 

Let  x\  =  (1,0, 0)T,  X2  =  (cos  7,  sin7, 0)T  and  y  =  (coscocos9,  sinwcos^,  sin0)T.  Let  M  = 
Span{a:i,  X2}  and  N  —  Span{?/}.  Here  An  =  1,  Am  =  1  —  cos  7  and  9m  =  9.  So  for  any  9  >  0 
M  ©  N  =  M3.  So, 

1  0  O' 

W  —  cos  7  sin  7  0 

cos  u  cos  9  sin  u>  cos  9  sin  9 

In  this  case,  analytical  expressions  for  the  eigenvalues  of  W*W  are  quite  complicated.  Therefore 
we  shall  demonstrate  the  lower  frame  bounds  numerically  for  a  few  values  of  7  and  ui.  Figures 
2-6  each  show  for  a  particular  value  of  7,  the  actual  lower  frame  bounds  and  the  estimate 
provided  by  Theorem  3.2  for  different  values  of  uj.  It  can  be  seen  that  the  lower  frame 


Minimum  subspace  angle  in  degrees 

Figure  2:  Example  III  with  7  =  7t/4.  Solid  Line:  Lower  frame  bound  estimate;  Dashed  lines: 
Actual  lower  frame  bound  for  different  values  of  u 

bound  estimate  becomes  increasingly  accurate  as  7  approaches  7r/2.  For  small  7  the  estimate 
is  quite  conservative  for  certain  values  of  u>,  however  in  these  cases,  there  also  exist  values  of  u> 
for  which  the  lower  frame  bound  is  close  to  the  estimate  of  Theorem  3.2.  In  this  loose  sense, 
the  estimate  of  Theorem  3.2  is  as  good  an  estimate  as  can  be  derived  using  knowledge  of  the 
minimum  subspace  angle  alone. 
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Figure  3:  Example  III  with  7  =  7r/3.  Solid  Line:  Lower  frame  bound  estimate;  Dashed  lines: 
Actual  lower  frame  bound  for  different  values  of  u 


Figure  4:  Example  III  with  7  =  7t/6.  Solid  Line:  Lower  frame  bound  estimate;  Dashed  lines: 
Actual  lower  frame  bound  for  different  values  of  w 

Example  IV:  Violation  of  Lower  Frame  Bound  when  9m  =  0 

By  this  infinite-dimensional  example  (which  can  be  found  in  [4])  we  show  that  the  lower  frame 
bound  can  indeed  be  zero  in  the  case  where  9m  =  0. 

Let  {ej}  be  the  standard  orthonormal  basis  for  / 2  and  let  '<p:)  =  j,  <j>j  =  \fl  -  1/j  e^j  + 
\/lJj  £3j+i-  Thus  the  sequences  {ipj},  and  are  orthonormal  sequences  and  thereby  frames 
for  their  respective  closed  spans.  However  if  we  consider  the  union  of  the  two  frames  and  take 
Z3k+i  G  Span{^-,  cf>j}  as  a  test  vector,  it  is  easily  seen  that 

t:  i(e3*:+i,  i>j)\2 + ^2  Ke3fc+i,^j)i2  =  —  ^iie3fc+iii2- 

3  3 

Hence  since  £  — *  0  as  k  — >  00,  the  sequence  {ipj,  <f>j }  is  not  a  frame  for  its  span. 
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0.7, 


Figure  5:  Example  III  with  7  =  37t/8.  Solid  Line:  Lower  frame  bound  estimate;  Dashed  lines: 
Actual  lower  frame  bound  for  different  values  of  u 


Figure  6:  Example  III  with  7  =  7n/l6.  Solid  Line:  Lower  frame  bound  estimate;  Dashed  lines: 
Actual  lower  frame  bound  for  different  values  of  w 

5  Conclusions 

In  this  report  we  have  provided  a  geometric  characterization  of  conditions  which  guarantee 
that  the  union  of  two  frames  is  a  frame  for  the  appropriate  direct  sum  space.  The  main  result 
of  this  report  is  contained  in  Theorem  3.2  which  says  that  given  frames  for  subspaces  M  and  N , 
the  union  of  the  frames  is  a  frame  for  the  direct  sum  space  M  ®  A  provided  that  the  minimum 
angle  between  the  two  subspaces  is  bounded  away  from  zero.  An  estimate  for  the  lower  frame 
bound  can  be  made  in  terms  of  the  quantity  1  —  cos  0m .  As  mentioned  in  Section  4,  the  lower 
frame  bound  estimate  in  Theorem  3.2  is  in  a  sense  the  best  estimate  which  can  be  made  using 
the  minimum  subspace  angle  alone.  Furthermore,  we  have  shown  that  the  lower  frame  bound 
is  nonincreasing  with  respect  to  the  lower  frame  bounds  for  the  original  subspaces. 
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